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A Nationwide Study of the Administration 
of Vocational -Technical Education 
at the State Level 



I. INTRODUCTION 
A. Statement of the Problem 

During recent years, the urgent need for a higjh -quality program of edu- 
cation for all children and youth has become recognized. Much pro- 
gress has been made in improving the status and quality of education at 
all levels. However, this progress has been uneven, with perhaps the 
greatest improvement in areas such as science, mathematics and for- 
eign languages. There is a serious question whether the progress in 
vocational -technical education has kept pace in many parts of the nation 
and whether current policies, programs and procedures are adequate to 
meet present and emerging needs in our rapidly changing economy. 

Presumably, deficiencies in vocational and technical education programs 
of local agencies can be reduced or eliminated through more effective 
leadership or Influence from the state and nationai levels. With vastly 
increased Federal aid and changing roles for such agencies as the Office 
of Education, there is some appi;ehension about undesirable Federal con- 
trol. Many contend the Feder^ government should not attempt to pro- 
vide direct assistance to local school systems. Some Federal leader- 
ship and financial assistance are necessary, but these should be imple- 
mented throu^ the appropriate state agency. 

Assuming that the American public will neither accept nor be asked to 
accept con^lete Federal financing and control, it then becomes imper- 
ative to have high-quality and effective leadership in vocational -techni- 
cal education at the state level. 

State Departments of Education (and also vocational -technical staffs) 
vary considerably in size, organization, function and otherwise. The 
average state department in 1963-64 had 75 professional staff members 
available to work on educational problems and programs and with an 
average of 425 districts. 

The 75 State Department of Education staff members worked directly 
with 1,303 schools and about 20,000 local school people --for the pur- 
pose of maintaining standards, providing teacher and administrator 



training and for the general improvement of education including buildings, 
materials, methods and teaching. 

Some State department consultants (18) estimated their average ’Visit'* 
to schools to be one half-day eadi seven years. A few were able to 
approach the level of one visit in each two-year perl od. Obviously, 
this situation precluded reliance upon the procedure of working with 
individual principals and teachers --especially when one takes cogni- 
zance of the time required for desk work and travel. It would be un- 
realistic to increase the State department staff believing that a larger 
staff alone could (under traditional procedure and organization) effec- 
tively influence change for improvement. 

The President's Panel of Consultants on Vocational Education (11) and 
others have spotlighted such widespread deficiencies in vocational -tech- 
nical education as: 



1. Vocational offerings which are limited in variety and in 
terms of numbers of persons served 

2. Programs which are unrealistic in terms of the needs of 
labor 

3. Inadequate concern and provision for the anticipated 21 
million non ; college graduates who are entering the labor 
market during the 1960’s and the added millions who need 
to be retrained in the years ahead 

4. A need for more effective State leadership to influence 
local programs. 



Major challenges confront state educational agencies in regard to such 
problems as: (1) the improvement of education firograms; (2) local- 
state -Federal relationships; and (3) the roles of various educational 
agencies. 

Changes are occurring in State education agencies, including those with 
responsibility for vocational -technical education. These are being 
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.Precipitated by socioeconomic developments in the country and to some 
extent accelerated by legislation such as the Vocational Education Act 
of 1963 (P. L. 88-210) and the Elementary and Secondary Education Act 
of 1962 (P.L. 89-10). 

Thus, there appeared to be a need to study these changes and to gain a 
comprehensive view of the current status of various facets of state - 
level administration of vocational -technical education. Hence, the pur- 
pose of this Project was to provide pertinent, accurate information for 
use, primarily, by state agency staffs in their efforts to meet the major 
challenges confronting them. 



B. A Selective Review of the Literature 



The literature which specifically contributed to the formulation of re- 
search objectives, basic assumptions (or hypotheses) and methodology 
of ^he several individual studies is reviewed in subsequent sections of 
this report. Only that literature which pertains to the purpose of and 
rationale for the Project as a whole is reported below. 

An important resource was Dr. Robert F. Will’s, State Education 
Structure and Organization (33). It provided a basic framework for 
analyzing organi^tion and structure and for studying the change process. 

Three recent studies, one in New York State and two in California, fo- 
cused attention on state organization for educational change. The New 
York study found that the state department of education (SDE) attitude 
about change influenced educational change throughout the state (5:37). 
This same report indicated that local educators looked to the SDE to 
assume a strong -leader ship -for -change role, but not to impinge upon 
basic decision-making at the local district level. The state division of 
vocational education (SDVE) faces challenges similar to those of the 
state departments of education generally. 

A recent study of the California State Department of Education (20) con- 
cluded (among other things) that: 

1. The California State Department of Education, as the 
staff and administrative agency of the State B(»rd of 
Education, has a vital role to play in the 0cate level 
planning process. 
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2. At\ it presently functions, the State Department of Edu- 
cation is not capable of its full potential in providing 
state support to the process of educational development. 
Major dianges are indicated. 

A later stuciy (19) in California brought out the following observations: 

The overlay of new substantive educational change on more 
traditional styles of administration and forms of organiza- 
tional structure has resulted in a variety of stresses: 

a. Inhibited communication and understanding and lack 
of agreement on the definition of district goals and 
objectives. 

b. Inhibited development and coordination of plans and 
programs to achieve those goals and objectives. 

c. Less than optimum utilization of valuable professional* 
resources and implementation of appropriate change. 

The July, 1965 White House Conference on Education emphasized the 
need for an analysis of the role and function of state -level educational 
agencies. 

". . . Therefore, if our educational system is to fulfill its 
functions of providing die skilled manpower we need, the in- 
telligent and informed citizenry we require, and the avenue 
for upward social mobility that we demand and desire for 
all citizens, action must be taken now to find ways to streng- 
then our state governments that have the primary responsibility 
for providing educational opportunity. " (21:42) 

". . . the role and function of state departments of education 
need considerable critical appraisal. Even a cursory exam- 
ination of the existing patterns of state organization in this 
area reveals a lack of any clear-cut notion as to what the role 
and function of these departments should be. " (21:53) 

By statute (P.L. 88-210, section 5(a), sub-sections 3, 5, 6, 7) the SDVE 
is given a regulatory role in that it administers the state plan for voca- 
tional education which: (3) "provides minimum qualifications. . . 

(5) "sets forth such fiscal control. . . (6) "provides assurance that 
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the requirements of section 7 will be complied with. . . (7) "provides 
for making such reports. . . " The same statute charges the SDVE with 
leadership responsibility for projecting employment needs, promoting 
cooperation between vocational programs and the State Employment 
Service, and communicating vocational opportunities in the state to 
local schools and vocational graduates. 

State education agencies developed primarily as inspectorial, regulatory, 
clerical, financial, and advisory agencies to support local education agencies. 

. . . The establishment of a permanent central agency for 
education in each state is of fairly recent origin. The 
original and principal continuing role of these central 
agencies has been regulatory and clerical. (32:64-65). 

. . . The state authorities generally declare minimum edu- 
cational standards for the school program, disburse state 
funds to the local districts, set minimum requirements 
for the certification of teachers, and sometimes buy and 
prescribe textbooks for grades. (8:124) 

Thurston and Roe have suggested that the state education agency have 
three principal functions: leadership, administration of special agencies 
and services, and regulation. (28:117-130) 

Regulatory functions are those which are performed to assure 
that the basic provisions for education. . . are followed, . . . 

For the most part, these regulatory activities include enforce- 
ment in regard to minimum standards in education. (28:79) 

The Council of Chief State School Officers also has suggested that the 
state education agency is a leadership -regulatory agency. 

State departments of education are responsible for enforcing 
laws and administrative rules and regulations that require 
local school districts to meet particular standards and com- 
ply with specific conditions. In carrying out this responsi- 
bility state departments are exercising state -wide regulatory 
controls. State departments are likewise responsible for 
providing professional and technical assistance to local 
school districts to help them meet and exceed the standards 
prescribed by state law and administrative rules and regu- 
lations. In carrying out this responsibility state departments 
are exercising leadership. (10:10) 
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Regulatory responsibilities are a direct consequence of state 
authority for education. While states have delegated broad 
author!^ to local school districts for the management and 
operation of the public schools they have also established 
safeguards to guarantee minimum performance. . .The es- 
tablishment of standards and the accompanying power to 
enforce compliance with them are commonly termed the 
regulatory function. (10:11) 

The state department of education should be the leadership 
center of the state system of education. Effective leader- 
ship contributes significantly to the improvement of state 
and local education programs. (10:13) 

Grant Venn discussed the state education agency both in terms of its 
traditional role, and its emergent role in the face of changing demands. 

Althou^ state boards of education were mainly clerical, 
statistical, and regulatory offices in the early years, the 
functions of these agencies have increased and broadened 
in scope as changes have taken place in American society. 

(32:65) 

The crucial role of the state education agency today is 
statewide leadership for educational planning, programs, 
and services. (32:66) 

A recent dramatic increase in federally supported activities 
has induced a new major role for state education agencies; 
namely, statewide planning, projecting, and interpretation 
of educational development needs. Most state education 
agencies have been ill-prepared to assume the added leader- 
ship responsibility. (32:66-67) 

Studies of the SDE have indicated a need for detailed research and de- 
velopment in state school administration, as well as lending support to 
the leadership-regulatory concept of state education agencies. R. E. 
Bills (4), in stucfying the perceived actual and ideal roles of county 
superintendents and of staff at the West Virginia Department of Educa- 
tion, found four basic points of orientation to the role of the SDE. 

These four were: 

1. The Rendering of Services 







2. The Promotion of Change 

3. The Exercise of Control 

4. A "Big Brother", or Overseer Function. 

The study suggested that "distinguishing features of an organization 
emerge not from the acceptance or rejection of these categories or role 
performance, but In the relative emphasis assigned to each", and 
raised questions regarding the emphasis upon each of the four role 
categories. 

In a period of profound and rapid change, it Is not enough 
for leadership simply to be In tune with the times; the 
need Is for a type of leadership which can help set the 
tune for the times. This being the case, should not 
factor 2--the promotion of change --become the Depart- 
ment's future hi^ value? Closely related, would we not 
find factor 1— the rendering of services --compatible with 
the objective of change in and through education? If so, 
the factors of control and overseeing would correspondingly 
diminish in importance. (A) ‘ 

The concept of involvement is crucial for change. Especially et the 
state level there is a need to enlist the help and support of a broad 
segment of the economic and political community as well as total edu- 
cational resources in order to establish effective policy and imple- 
ment new ideas for educational programs. The need for involvement 
of all segments of education in planning for the future has been indicated. 

. . .Hopefully, leadership in making these (educational) de- 
cisions will come from all segments of the educational 
community. Up to now, consistent educational Jeadership 
has all too frequently been absent. If the educational 
community does not reach a consensus on how the job is to 
be done, it may be told what to do through categorical fin- 
ancial aid (as happened under the Smith-Hughes Act) or 
some governmental agency may be directed to take over the 
job. (32:154) 

The role of the state department has undergone a fundamental 
shift; it no longer is inspectorial. State departments have the 
resources to give educational leadership, and maybe this 
leadership function tends to be conceived in the triangular 
relationship with higher education and local school districts. 
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There are highly competent personnel in all three 
agencies and all levels and the problem is to co- 
ordinate a team approach so that a niaximum edu- 
cational opportunity for youngsters will result. 

(32:1159) 

The state department of education either must develop 
the quality of personnel needed for its new leadership 
role, or somebody else will, and the state depart- 
ment will become a strictly vestigal agency, as it has 
in many states. (32:1157) 

. . . A stronger state department of education is re- 
quired. . .however, strength makes itself felt through 
die quality of leadership rather than throu^ regu- 
lation. ( 32:408) 

Recently, two trends were noted in the development of educational policy. 
One of diese trends was the strengthening of state governments and im- 
provement of state education agencies. Perhaps now, with strong pres- 
sure from the federal government, the SDE will accept the leadership 
role. 

. . . Perhaps the greatest new development on the policy 
front to be expected within the next half generation is the 
shifting notion of who controls public educational policy. 

Two trends are evident here. On the one hand, there are 
the proponents of a national educational policy set in 
Washington and those who advocated the maintenance of 
the present system, whereby educational policy is set 
on a state and local basis. If local control of educational 
policies is to be preserved, the s' ttes will have to step 
in. (22:118) 



C. Focus and Objectives 



The focus of the Project was upon the organization, functions and 
activities of state agency administration of vocational -technical educa- 
tion, with the purpose of providing pertinent information to directors 
of vocational education and their staffs which might contribute to 
enhancing their leadership role and improve state agency administration. 

- 8 - 



o 



A further goal was to develop techniques or instruments for implementing 
the central purpose stated in the Project Proposal- -"to expedite improve- 
ment in the scope, quality and coverage of vocational and technical 
education in local schools, by increasing the effectiveness of state agency 
leadership, service and administration in this field of education." 



The Objectives 

1. To prepare a detailed description of the administration of and ser- 
vices provided for vocational -technical education in each state, indi- 
cating the differences among states in organization, personnel and 
services provided and identifying current trends in administrative 
organization functions and activities. 

2. To identify and analyze perceptions of what the roles and functions 
of state agencies for vocational -technical education are and what 
they should be. 

3. To analyze activities of selected professional staff positions. 

4. To design and field-test a format and criteria for self-analysis by 
state agencies for vocaticxial -technical education. 

5. To analyze the expenditures for vocational education through the 
state agency for these programs which are operated in public 
schools and related to Federal funds provided to states for this 
purpose. (Special emphasis was given to changes in expenditures 
following passage of the Vocational Education Act of 1963). 
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II. METHOD 



A. Organization of the Project 



The Project was divided into several more or less independent studies, 
each designed to meet one of Uie above -stated objectives. SectionsTII 
through VII of this report describe in detail the research design and 
methodology for each study. 

The Project Director worked alternatively with the staff members in- 
dividually and as a group to assure adherence to the approved proposal 
and to achieve integration of the several studies (sub-units) into a co- 
ordinated whole. 

Program Evaluation and Review Technique (PERT) was applied to the 
total project in order to facilitate the integrated planning and implemen- 
tation of the various sub-units. 

This analysis of the process of the total project was suggested by a 
member of the U. S. Office of Education staff who thought such a com- 
plex project would benefit from such an analysis. It was thought that 
the method developed might also serve as a guide for other major com- 
plex projects. 

One staff member. Miss Sara Pierce, was responsible for this unit of 
the project. 



B. Program Evaluation and Review Technique 



Program Evaluation and Review Technique (PERT) is a method fcr plan- 
ning, replanning and for evaluation. Developed in tlie late 1950*s by 
»:he Navy Special Projects Office, it was used in the development of the 
Polaris submarine. PERT now has wide use in industry and some in 
government. 

PERT has not been used extensively in education in the past. However, 
it should have the same degree of effectiveness witli educational research 
and development projects that it has had with industcrial research and 
development. 
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PERT is organized by a "top-down" method. From the objectives ^ich 
are to be achieved, subdivisions are made in order to identify all ele- 
ments of the project. This Insures chat the major objectives are sup- 
ported in all phases. 

Application of PERT to this Project is described below. A detailed 
discussion of PERT may be found in Appendix II. 

Three months after the beginning of the Project, Miss Sara Pierce was 
employed to serve as staff PERT technician. Prior to any data being 
collected for the implementation of PERT, the objectives of the Project 
had been established. The Project had also been divided into the several 
sub-units, which were to l ^ active throughout the Project and thus to be 
PERTed. 

A consultant* spent several days with the Project staff. He introduced 
them to the basic uses and methods of PERT. He also worked with 
the staff technician on the techniques needed to Implement PERT for 
the Project. 

In July the staff technician completed a seminar and workshop at the 
PERT Orientation and Training Center of the Department of Defense 
in Washington, D.C. This seminar dealt with the intricacies of methcxi- 
ology and analysis reports. 

The Project Director worked closely with each staff member in (tevel- 
oping, coordinating and implementing details of research design and 
plans in general. Including formal PERTing operations. The staff 
PERT technician attended the many staff meetings in which details 
were discussed and was responsible for the machine processing, key 
punch, computer printout arrangements, chart preparation and technical 
explanations necessary in connection with the orientation of staff and 
PERT implementation. 

The first step in PERTing this Project was to break the total Project 
and its objectives into elements. The Project had been divided into 
sub-units which were organized along similar lines and thus the Project 
was treated as a whole in this step. 



* .Dr. Desmond L. Cook from the Ohio State University 



In breaking the elements into activities and events and developing a 
network for them, each staff member responsible for one of the seven 
sub-units was consulted individually. 

After some groping and learning on the part of all concerned, a D.C. S. 
copy of the NASA -PERT "C " program was adjusted to the University 
7094 D.C.S. computer and became operational. 

Once PERT was operating, the decision was made, in accordance with 
the plan of expected benefits, to retrace steps and make a run of the 
daia as of July 1, 1966. The reason for tills run was to give some con- 
tinuity to tiie PERT of the Project and a more complete basis for evalu- 
ating its possible effectiveness. July 1 was chosen because of staffing 
patterns which would have made an earlier run impractical and because 
this would be one year before the end date of the Project. 

The procedure for simulating this run was to begin with the old and in- 
complete data which had been collected by June 1, 1966, and obtain staff 
cooperation in completing the data as they could remember it from that 
date. The staff realized it would be simpler and more beneficial to go 
back to the starting date, January 1, 1966, for each sub-unit, and, there- 
fore, this was done for the simulated run; The staff members completed 
the data as if they were just beginning the work on their sub-units. Al- 
though the date given for the run was January 1, 1966, it actually was 
seven separate runs. The starting date for each run was the date work 
was begun on a sub-unit. These dates varied from Ja.mary 1 to July 1, 
1966 . 

After the first actual run, the staff reevaluated progress and made some 
major changes. 

The last run of PERT for the Project was made April 28, 1967, to en- 
compass the first 16 months of the 18-month Project. All changes were 
fed into the data deck to up-date it effective that day. The staff was then 
able to see just how effective the changes were which had been made as 
a result of the January run. 

There were several problems encountered in the PERT for this Project. 
The first computer program which was thought to be compatible for 
this Project and available hardware was not appropriate for the computer 
at the University of California. Programmers at the University Com- 
puter Center worked with the program for some weeks in an attempt to 
adapt the Standard 7094 to a 7094 D.C.S. computer. Finally a D. C. S. 
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copy of the NASA -PERT "C" program was obtained from Ames Research 
Center and additonal weeks were spent ironing out the difficulties in 
this program. By the first of August it was possible to run some intro- 
ductory material for one sub-unit. 

The situation was complicated by the fact that, although the Project 
starting date was January 1, 1966, formal notification was not received 
until July 1966, and the staff was gradually increased from January to 
September. As staff were gradually recruited and began work, the 
Director necessarily had to spend a great deal of time in orientation. 

PERT was new to all concerned, and there was recurring need to orient 
new staff. Ideally, the staff should have been oriented together. For 
many reasons, latecomers had to conform to some of the plans (PERT- 
ing) done by others. Some staff had difficulty in making detailed plans 
as rapidly as was necessary, but subsequent experience demonstrated 
the v^ue of planning- -even though often this had to be tentative and sub- 
sequently revised. Some staff, because of heavy schedules, found it 
difficult to orient themselves to the total planning process. 

The use of PERT lent considerable impetus to this Project and gave the 
staff valuable experience in "learning by doing" with an operable PERT. 



C. Consultation and Coordination 



Several meetings and conferences were held with individuals and pro- 
fessional organizations for purposes of general orientation, support, 
cooperation and involvement. Staff members participated in and 
orally reported progress to meetings of the National Association of 
State Directors of Vocational Education, the Council of Chief State 
School Officers, the American Vocational Association, the Office of 
Education (HEW) and others. Seven meetings were held with groups of 
state directors and chief state school officers. 

The Project staff were alert to the need to coordinate their activities 
with those of two other centers for research and development projects 
in vocational -technical education. Seven meetings were held with re- 
presentatives of Ohio State University and the University of North 
Carolina for this purpose. 
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D. Procedure for Data Collection 



To the extent possible and practical, data collectiori for each of the 
studies was combined. All primary sources of data and some secon- 
dary sources were obtained by means of visits to each state. 

The procedures for securing data followed a similar pattern in each 
state. 



a. Readiness Visits 

The visits were held in each state to orient and prepare the 
state for subsequent data collection sessions. The format of 
each readiness visit followed a similar pattern: a Project 
staff member met with the chief state school officer, the 
state director of vocational education and some of their staff 
in both general and vocational education to explain the over- 
all purposes of the Project and to elicit theix' cooperation and 
participation in collecting the required data. 

Following this initial visit, a letter outlining the purposes 
of the Project, a description of the sub-units of the research 
effort and a list of categories of persons requested to parti- 
cipate in the subsequent major data collection meeting. 

b. Data C!ollection Visits 



The purposes of the second state visit were: (1) to explain 
the Project; (2) to help participants understand some of the 
needs and possibilities for change; and (3) to secure data 
required for the study and analysis for each of the sub-units. 

This second visit usually followed the readiness meeting after 
about one month. The agenda for this visit followed a similar 
pattern in all states: On the first day, a large group meeting 
with (1) a flannel board presentation and overview of the Pro- 
ject; (2) a division of participants into small groups for the 
purpose of administering the Group Inty view Guide; (3) a 
second flannel board presentation £md discussion of "The Pro- 
cess of Change;" (See Appendix I) and (4) detailed group dis- 
cussions about opinions, suggestions, problems, strengths. 
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V/eaknesses and questions about the status of state -level 
administration of vocational-technical education. 

A second day was used for individual interviews and the col- 
lection of reports and documents reflecting the current status, 
including the financing, of the state division. 

In 16 states visited, a third day was spent preparing the state 
division professional staff to participate in the position analysis 
study. 

The following map indicates the states visited and the t3rpes of data se- 
cured. Table 1 (page 17 ) summarizes the number of persons partici- 
pating in data collection in each state. 

Data from the following sources were secured by means of state visits: 

(1) the Group Interview Guide, (2) Individual Interviews, (3) Personal 
Recond of Work Activity form, and (4) various documents and other 
materials. The last source of data was obtained also by mail from the 
states, directly from the U. S. Office of Education, or from the library 
of the University of California. 



E. Data Processing and Preliminary Analysis 



All data collected both in the field and through secondary sources were 
centrally controlled in the Project office in order to preserve confi- 
dentiali^ and to maintain a complete record of all data received. After 
the data had been checked for completion and accuracy, they were re- 
leased for use to the several chairmen of the various studies (sub-units). 

Data for two studies (Perceptions and Position Analysis) were processed 
through an arrangement with the Survey Research Center, University of 
California, Berkeley. Some data processing and analysis made use also 
of the Computer Center of the University of California. 

Specific methods of analysis are discussed for each study in the fol- 
lowing sections of this report. 
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TABLE 1 



E* Listing of States and Numbe rs of Respondents involved 
in Data Collection Between July 1966 and June 1967 



Group Data- Indiv idual Position 

Gather infyisit- - Interv iewi-- Analysis-- 

Number of Number of Number of 

Group Interview Respondents Respondents 

State Respondents 



1. 


Alaska 




in 




2. 


Arizona 








3. 


Arkansas 






. . . . 12 


7 


4. 


California 








5. 


Colorado 






.. 


6. 


Connecticut 


47 






7. 


Delaware 








8. 


Georgia 








9. 


Hawaii 








10. 


Indiana 








11. 


Iowa 






m 


12. 


Kentucky 






6 


13. 


Maine 








14. 


Maryland 








15. 


Massachusetts .. 


59 




m 


16. 


Michigan 


43 




.... 6 


17. 


Minnesota* 


37 






18. 


Mississippi 


46 






19. 


Missouri 








20. 


Nebraska 






tm tm 


21. 


Nevada 








22. 


New Hampshire . . 


49 






23. 


New Jersey 


68 • 






24. 


New Mexico 


40 




7 


25. 


New York 








26. 


North Carolina . . 


61 







♦ North Dakota instruments were lost in the mail, and Minnesota and 
Texas completed too late to analyze and include in this report. 
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Group Data- 


Individual 


Position 






GaHiering Visit-- 


]feterviews-- 


Analysis-- 






Number of 


Number of 


Number of 






Group Interview 


Respondents 


Respondents 




State 


Respondents 






27. 


North Dakota* . . 


34 






28. 


Ohio 






7 


29. 


Oklahoma 


54 






30. 


Oregon 






6 


31. 


Pennsylvania . . . 


53 




7 


32. 


Puerto Rico . . . . 


44 






33. 


Rhode Island . . . 


53 






34. 


South Carolina . . 


52 






35. 


South Dakota - « . . 


30 






36. 


Texas* 




7 . 




37. 


Utah 








38. 


Vermont 








39. 


West Virginia . . . 


36 






40. 


Wisconsin 








41. 


Wyoming 






5 




Total 










Respondents . . 


. . . 1932 




... 106 



See footnote, previous page. 
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m. THE CURRENT STATUS OF THE ORGANIZATION FOR 
ADMINISTRATION OF VOCATIONAL -TECHNICAL 
EDUCATION AT THE STATE LEVEL 



This study of the administration of vocational -technical education begins 
with a presentation, in summary form, of the present organization and 
activities under the direction of each state board of vocational education. 
This summary is presented in ten sections under the following titles: 

I. Legal Basis for the Administration of Vocational- 
Technical Education 

II. Selection of State Officers for the Administration of 
Vocational -Technical Education 

III. Position of Vocational -Technical Education in the State 
Administration of Education 

IV. Organization for the Administration of Vocational - 
Technical Education 

V . Professional Staff for Star^ Administration of 
Vocational -Technical Education 

VI. Teachers in Vocational -Technical Programs 

VII. Enrollments in Vocational -Technical ^ograms 

VIII. Teachers and State Staff in Vocational -Technical 
Programs 

DC. Schools Providing Vocational -Technical Programs 
X. Income and Expenditures for Vocational -Technical 
Education 

This unit of the total project was under the immediate direction of J. 
Chester Swanson, assisted by a research staff consisting of Paul 
Railing, Phyllis Warren, Patricia Cone and Harold Kinser. The 
following persons served in a consultative manner to this unit of the 
project: 

Walter M. Arnold, Assistant Commissioner, U.S. Office of 
Education, and Director of the Division of Vocational and 
Technical Education 

J. R. Cullison, State Director of Vocational Education, Arizona 

John Bunten, State Director of Vocational Education, Nevada 

Wesley Smith, State Director of Vocational Education, 

California. 



- 19 - 



This study was often called a "snap-shot picture" of the state activities 
for vocational education. However, it soon became apparent to the 
staff that conditions were changing so rapidly that a "snap-shot" 
created a picture which was likely to be distorted. When the attempt 
was made to use recent data, they were either not available or were 
subject to revision. When data were used which were stable, the data 
and their analyses were obsolete in many respects. This was particu- 
larly true of the 1965-1967 period because of the effects of the recently 
increased appropriations under Public Law 88-210. 

These changing conditions, and the fact that this information was taken 
from so many different sources, made it impossible to completely 
justify all data with other sources or to make it consistent within the 
report. 

The major sources of information for this unit of the study were: 

1. A Review of Activities in Federally A^d ^oqrains. 
Vocational and Technical Education- -fiscal \ear 1963 . 

2. Summaries of annual reports of state boards for voca- 
tional education, fiscal years 1965 and 1966. These 
data will later be published under the title of item "1" 
above for fiscal years 1965 and 1966. 

3. The state plans for vocational education. 

4. The state directories of professional staff. 

5. The current organizational charts for the state depart- 
ments of education and the state divisions of vocational 
education. 

6. The education code for each sta; 

All State Directors of Vocational Education and many of their staff con- 
tributed to this study in a significant manner. 
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Introduction 



This is an attempt to summarize a very complex situation- -the organi- 
zation and program activities of vocational education at the state level 
in all 50 states. 

In striving for simplicity, the summarization may make it easy for the 
reader to draw conclusions and make generalizations which the details 
of the situation would not justify . Because a number of sources were 
used to obtain recent data, some of the details in the tables of the in- 
dividual states may not be consistent with data published elsewhere. 

One of the difficulties of such a study is that definitions are not standard 
for all the states and even the breadth of activities within the responsi- 
bility of a single state division of vocational education varies widely. 

An attempt is made here to show, in organizational charts and listings 

staff, the total activities and responsibilities of each 
division of vocational education. However, when specific vocational 
education tabulations are shown, such as enrollments, teachers, schools, 
etc. , the objective is to present only program activities which conform 
to the definition of vocational education as given in the most recent 
Federal legislation for vocational education. * This means that where 
state divisions of vocational education have responsibilities for in- 
dustrial arts, guidance other than vocational guidance, home economics 
which does not train for gainful employment, etc. , the data for these 
are not reported as vocational education activities. At times, it is 
difficult to differentiate between some of these activities. 



Legal Ba sis for the Administration of 
Vocational -Technical Education 



The constitution of each state provides for the establishment, organi- 
zation and operation of a system of public schools. But, no state con- 
i^titution specifically mentions vocational education. The statutory laws 
of all states, however, do mention vocational education. In all states, 
the statutory law accepts the acts of Congress which "provide for the 
promotion of vocational education" and designates a state board to act 
as the State Board for Vocational Education. This uniformity of the 
statutes is made almost mandatory by the provisions of the Federal 
acts. 



♦ Public Law 88-210, Part A, Section 8(1). 
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Many states do have a considerable number of statutes related to vo- 
cational education. In general, their difference is the inherent dif- 
ference among states as to what is enacted as a statute and what is 
provided as policy by state boards. 

In a number of states, the opinions of attorneys general were necessary 
to clarify the intent of previous vocational education legislation so that 
any new Federal legislation and aid would be accepted and recognized 
legally by the states. 

It does not appear that the state constitution or the statutory law in the 
states hinders the administration or operation of vocational education 
services. If, however, the question was asked, "could constitutional 
or statutory laws be enacted which would improve vocational education?", 
the answer would be difficult to find. A constitutional provision or a 
legislative enactment could give more status, provide a mandated mo- 
tivation and give immediate solutions to existing problems in some 
states. For example, in some states new legislative action in regard 
to vocatioMl education for adults and out-of-school youth would super- 
sede or eliminate otlier legislation which presently restricts the use of 
public fimds for these purposes. Yet it is difficult to suggest specific 
legislative action in this study. Obviously there are effective methods 
of solving problems relating to the administration and operation of 
vocational education within a state . 

In general, the weaknesses in vocational education are centered in (1) 
financial limitations, (2) lack of concern and/or knowledge of the im- 
portance and value of vocational education by persons in strategic po- 
sitions in state government, (3) the "image" of vocational education in 
the minds of educators and parents and (4) the common human frailities 
of inefficiency or ineffectiveness. All except item (1) are probably im- 
I^ssible to correct by legal mandate, and the provision of additional 
finances does not necessarily require a statute, but merely an appro- 
priation. 



Selection of State Officers for the Administration 
of Vocational -Technical Education 



There are 50 chief state school officers. Twenty three are elected by 
the people of the state, 22 of them are appointed by the State Board of 
Education and five are appointed by the governor of the state. Forty- 
five of the chief state school officers are executive officers of the State 
Board for Vocational Education of their state and thus become the hipest 
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administrative officials in the state vocational education system. 

Titles of the chief state school officers may be cataloged as follows: 

State Superintendent of Public Instruction . 27 states 
State Commissioner of Education ..... 16 states 

State Superintendent of Schools 4 states 

State Superintendent of Education 3 states 

There are also 50 state directors of vocational education. In five states, 
the director is appointed by the State Board for Vocational Education and 
is the executive officer of the board. In 45 states, he is appointed by 
the chief state school officer, ^ 



All states use the tide of State Director of Vocational Educati'^n at 
times for the professional staff member with the major responsibility 
for vocational education, but the tide varies more widely than doeb the 
tide for the chief state school officer. 

The tides may be listed as follows: 



State Director of Vocational Education 
(exclusively) 28 states 

State Director of Vocational -Technical 
Education states 

State Director of Vocational -Technical 
and Adult Education 1 

State Director of Vocational Public High 
School and Adult Education . , , , 1 state 

State Director of Vocational and Adult 
Education 1 state 



Chief, Vocational -Teclmical Education l state 

Chairman and Director of Vocational Education . . 1 state 

Administrator, Vocational and Technical 
Education 1 state 

Executive Director of Vocational Education .... 1 state 
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Program Administrator of Vocational and 
Technical Education 1 state 

Chief, Bureau of Vocational Education 1 state 

Director, Bureau of Vocational, Technical 
and Continuing Education 1 state 

Assistant Superintendent for Vocational 
Education 4 states 

Assistant Superintendent for Vocational, 

Technical and Adult Education 1 state 

Assistant Superintendent for Vocational- 



Technical Education and Extended Services ... 1 state 



Assistant Commissioner for Vocational 
Education 4 states 

Assistant Commissioner for Occupational 
Education 1 state 

Associate Commissioner for Vocational - 
Technical Education 1 state 

Associate Commissioner for Vocational 
and Adult Services 1 state 



It would appear difficult to think of a combination of terms which would 
create a nvew title. The ’’assistant” or "associate" title usually indi- 
cates a higher status in the authority hierarchy than the other tides. 

In five states, the state director reports directly to the State Board for 
Vocational Education (which usually is the same as the State Board of 
Education); in 35 states, he reports directly to the chief state school 
officer; and in 10 states he reports throu^ one, and in some cases two 
other persons before his information or opinions reach the state super- 
intendent or the state board. 



The Position of Vocational -Technical Education in 
the State Administration of Education 



The most common pattern of organization for the state administration 
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of vocational education is illustrated by Diagram 1 below. 



Diagram 1. Most Common Pattern of State Organization 
~ for the Administration of Vocational-Tech- 

nical Education 4 (Typical for 45 States) 




As described earlier, many different titles are used for the several 
professional positions shown on this diagram, and a number of methods 
are employed in appointing persons to these positions, but the essen- 
tial personnel, relationships and activities are quite similar. This 
organization of administration is actually in operation in the 45 states 
for which it is a pattern. Because it operates in 90% of the states, 
it would be difficult to prove that this pattern or organization is not 
effective. However, it would be even more difficult to prove that it 
is the most effective pattern. 

Another pattern is found in three states. This pattern is illustrated in 
Diagram 2. 
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Diagram 2. Pattern of State Organization for the 

Administration of Vocational-Technical 
Education. (Typical of 3 States) 



Ielectorat~3 





Icovernorl 

i 


State Board of Education 
and/or 

State Superintendent of 
Public Instruction 


jState Board for 
{Vocational Education 


- 1 


JState Director of 




Ivocational Education 



All Vocational-Techncial Edu- 
cation Activities 



In this pattern of organization, the vocational education activities are 
under a single administrator and a separate policy-making board. The 
administrator and this board, however, are not under the direction of 
either the administrative authority of the secondary schools or the post- 
secondary institutions . Some of the inherent articulation problems may 
be prevented by having some interlocking members on the different 
boards. 

A difference in this pattern is found in one state. In this variation, 
the organization remains the same, but high school vocational educa- 
tion activities are separated from post-secondary and adult education 
activities even though the State Board for Vocational Education is the 
sole legal agency for administering all vocational education programs 
in that state . The State Board for Vocational Education contracts with 
the State Board of Education for the operation under the State Superin- 
tendent of Public Instruction, of vocational education programs in 
secondary schools. But, the post-secondary and adult education activ- 
ities remain the immediate responsibility of the State Board of Voca- 
tional Education and its executive officer . 

Diagram 3 (on the following page) shows an organizational pattern which 
is unique and cannot be considered a variant of either of the first two 
patterns . 

The pattern seen in Diagram 3 divides the responsibilities for voca- 
tional education between high school and post-high school levels. It 
also divides the responsibility for the activities of the state director 
between two authorities. Either of these divisions of authority and 
activities mighit lessen efficiency and at times cause severe problems. 



o 

ERIC 
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Diagrzun 3. A Unique Organization for the Administra- 
■" tion of Vocational and Technical Education. 

(Unique to one State) 




This division of responsibility for vocational education bet>^*een high 
schools and post- secondary institutions appears in five of the states 
using the pattern of Diagram 1. 

It may be significant to note that only one state (Wisconsin) has a com- 
pletely dual system at state and local levels and that this state enjoys 
the reputation of having one of the best vocational education programs 
in the nation. 



Or^nization for the Administration of 
vocational -Technical Education 



The organizational su:LCture within the divisions of vocational education 
in most states consists primarily of specialists in traditional occupa- 
tional categories. 

Six states have organizations largely unrelated to the traditional occu- 
pational categories. Many states have provisions for some new types 
of services. A number of others are in the process of major reorgani- 
zation toward creating such services. Innovations are beginning to 
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appear in the state organization, but these are too new at present for 
any one to determine a trend or make an evaluation. 

The state division often has some activities which do not conform to 
the definition of vocational education or its ancillary services . The 
most common services of this t)rpe are industrial arts and homemaking. 
The newer activities are usually research, health services, work* 
study and/or guidance. 



Professional Staff for State Administration 
of Vocational -Technical Education 



The professional staffs of the state divisions for the administration of 
vocational education differ considerably in size. The following tabu- 
lation summarizes this information. 

Number of Pro- Number of 

fessional Staff States 



Range 



0 - 


9 


3 


10 - 


19 


14 


20 - 


29 


11 


30 - 


39 


7 


40 - 


49 


5 


50 - 


59 


6 


Above 60 


4 



Smallest Staff 6 
Median Staff 25 
Largest Staff 89 

The titles for the various professional staff vary considerably as do the 
assignments or activities performed under the same tide. The staff 
tides are related to the variation in tides used in administration, super- 
vision and management throughout the country. The practices are in- 
terrelated within the general boundaries of a state or a region rather 
than being uniform educational usage. The variation in activities per- 
formed under a single tide is ususally related to type of organization, 
unique competencies of personnel or unique operating characteristics 
of the immediately responsible superior. 
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It is interesting to compare the size of the state divisions' staffs to the 
number of teachers in vocational education within the state. The range 
of this ratio is from a low of 1 to 240 to a high of 1 to 9. The median 
ratio is 1 to 52. These ratios can be summarized as follows: 

Ratio of Vocational Teachers to 
State Vocational Division Professional Staff 

Ratio Range Number of States 



0 


to 


1:9 


1 


1:10 


to 


1:19 


3 


1:20 


to 


1:29 


7 


1:30 


to 


1:39 


5 


1:40 


to 


1:49 


6 


1:50 


to 


1:59 


9 


1:60 


to 


1:69 


4 


1:70 


to 


1:79 


3 


1:80 


to 


1:89 


1 


1:90 


to 


1:99 


2 


1:100 to 


1:199 


7 



Over 1:200 2 



It is very difficult to determine a basic reason for this wide variation. 
A major contributing factor is that states with small enrollments must 
maintain certain basic services which may result in a relatively large 
ratio. This is indicated by the fact that of the ten states with the hip- 
est ratios, eighv had vocational enrollments of fewer than 21,000 (less 
than 20 % of the average vocational enrollment per state). Of the ten 
states with the lowest ratios, one has a very large enrollment, four 
had large enrollments and four were below the national mean state en- 
rollment. (One of these states has the mean state enrollment. ) 

Obviously, the ratio is determined to a great extent by the philosophy 
of the state agency as reflected in the practices and supervisory ser- 
vices made available to local and institutional programs in and by a 
given state staff. A further in-depth smdy of these differences would 
be invaluable in evaluating the leadership and program development in 
each state and as compared with that of other states. 



Schools Providing Vocational -Technical Education Programs 
The total number of public schools and colleges offering vocational 
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technical education programs in the 50 states and Puerto Rico approxi- 
mates 17,000 individual institutions. Although the greatest proportion 
of programs are found in regular or comprehensive hi^ schools, 21 
states reported the operation of area vocational schools. 

The number of area vocational schools ranged from one such school in 
three states to 99 area vocational schools in one state. The total num- 
ber of area vocational schools reported is 257. This is a rather im- 
pressive development inasmuch as Federal appropriations for area 
school construction are of recent origin. 

The trend toward providing more vocational -technical education in 
post-secondary schools appears to be continuing. Forty-six states 
have reported a total of 741 post- secondary schools offering vocational - 
technical programs . 



Income and Expenditures for Vocational -Technical Education 

Total public expenditures for vocational -technical education for the 
year 1965-66 was almost $810,000,000. This figure represents 
approximately a 150% increase in such expenditures over 1962-63. 
Although Federal support for vocational -technical education programs 
has increased dramatically since 1962-63, both state and local sources 
of funds constitute the major contribution to this field of education. In 
1965-66, local school district funds accounted for 44% of the total 
source of funds for vocational -technical education; 28% was contributed 
by state |unds; and 29% was the share of the Federal government. 

Expenditures for operation of the state division of vocational education 
vary from 2% to 10% of the total expenditures for vocational -technical 
education. Support for state agency administration appears to be 
equally shared by Federal and state sources of funds. 

The largest part of the great increase in Federal aid for vocational edu- 
cation was used for the construction and operation of vocational -tech- 
nical programs in schools. 



Conclusions and Suggestions 

In attempting to describe the organization and program activities of 
vocational education at the state level in all 50 states, there is the 
danger of oversimplification of a complex situation. Among the 
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difficulties of such a study are lack of standard definitions among 
states, variation in the breadth of activities within a single state di- 
vision of vocational education, and inconsistencies in reporting. A 
need for greater standardization in reporting has been found. 

The new developing occupational clusters for which training is now 
being provided cannot be classified and reported according to tradi- 
tional categories. Thus, there should be some modification of the 
present classification system. 

This report covers only those vocational -technical education activities 
which conform to the definition of vocational education as given in the 
most recent Federal legislation (P.L. 88-210). A complete nationwide 
analysis of vocational -technical education in the United States would 
require total reporting of all funds and programs for vocational edu- 
cation. At present, such information is unavailable. Future research 
studies should be directed toward developing methods and techniques 
for securing complete and comprehensive data which would reveal the 
total extent of vocational -technical education in the United States. 

On the basis of data collected to date, it would appear that in most 
states, vocational education is an integral part of the state's total 
public education program. In every state, providing vocational edu- 
cation is required by statute. Under Federal law each state must have 
a public board for vocational education which is empowered to contract 
for Federal funds for vocational education. In most states the State 
Board of Education is designated the State Board for Vocational Edu- 
cation, constituting further evidence of the integration of vocational 
education into the state's public education system. 

In 45 states, the chief state school officer is the executive officer of 
the State Board for Vocational Education, and in most states the Dir- 
ector of Vocational Education reports directly to the chief state school 
officer. There appears to be a trend toward higher status of the Dir- 
ector of Vocational Education in the administrative hierarchy. 

There is great variation among the 50 states in the number of profes- 
sional staff members in the state agency for vocational education in re- 
lation to the number of vocational education teachers in the state. Al- 
thou^ it is difficult to determine a basic reason for these differences, 
a major contributing factor appears to be size of enrollments in voca- 
tional education programs. States with small enrollments still must 
maintain certain basic services which tend to result in relatively hi^ 
ratios . 
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Further in-depth study of the differences in these ratios among the 
states would be invaluable in assessing the influence of state agency 
philosophy on the size of the ratio, as obviously the ratio determines 
to a great extent the practices and supervisory services made avail- 
able to local and institutional programs in and by a given state staff. 
Such a study would be helpful in evaluating the leadership and program 
development in each state as compared with that of other states. 

Dramatic changes in administration, staffing and financing vocational - 
technical education took place between the years 1964-65 and 1965-66. 
To determine whether these changes are unique or whether they indi- 
cate a trend will require continued research and updating of data. 
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IV. STUDY OF PERCEPTIONS OF STATE -LEVEL ADMINISTRATION OF 

VOCATIONAL-TECHNICAL EDUCATION 



A. Introduction 



The purpose of this study was to secure the perceptions of persons with 
major responsibilities or sincere concern as to the effectiveness of voca- 
tional education services in the public schools of tneir state. This unit 
of the Project was conceived and planned primarily by Allen Lee. 

In developing the research design^ it was deemed appropriate to divide 
the stu4^ into two parts: the major study deriving its data solely from 
the Group Interview Guide; and a second study utilizing data secured 
primarily through individual interviews. 

Charles Achilles assumed primary responsibility for the development of 
the Group Interview Guide and for implementation of the major stuc^. 
Consultation concerning the statistical design and analysis was received 
from Robert Heath. Boyd Applegarth, E. E. Holt and Allen Lee con- 
ducted most of the data collection sessions— the administration of the 
Group Interview Guide. A. R. Hunger, J. R. Strobel, Charles Achilles, 
John Nasitian and J. C. Swanson assisted in a number of sessions. 

The analysis of data was under the direction of Charles Achilles with 
the assistance of Robert Heath and Phyllis Warren. 

This unit of the Project required the largest commitment of staff and the 
greatest amount of time. The many states involved, the necessity of a 
"readiness" session before the major session and the detail analysis 
explains this major commitment of time and staff. 

John Nasman developed the second study, and E. E. Holt with the as- 
sistance of several consultants designed the individual interview sched- 
ule. E. E. Holt, Boyd Applegarth, Joseph Strobel, A. R. Hunger and 
Byron Stetler conducted most of the interviews. 

The analysis of the interview data was under the direction of Phillis 
Warren with the assistance of Mr. Nasman, Mr. Holt and Mr. Stetler. 



B. Theoretic Framework and Background 



The State agency for vocational technical education, often referred 
to as the State Division of Vocational Education (SDVE) was the focus of 
^is study. An attempt was made both in terms of perceptions of what 
is, and of what should be, to study the SDVE role as expressed by repre- 
sentatives of local schools, area schools, higher education, the SDVE 
itself, the rest of the State Department of Education (SDE), and other 
agencies. 

The activities of any organization depend partly upon the law, rules, re- 
gulations, and policies which are in effect. Role studies have shown 
that expectations are also influential factors affecting performance. 
Expectations stem from a variety of sources and may indicate a person's 
concept of an ideal, or of what should be. Perceptions, on the other 
hand, relate to a person's concept of the actual, or of what "is". An 
accurate conception of the role of the State agency for vocational and 
technical education (SDVE> as expected and as perceived by individuals 
and members of other agencies that interact with or are a client system 
for the SDVE, may well constitute a base for decision-making, and for 
the study of administrative aspects of vocational education. 

One purpose of this study was to "take a look at" the SDVE in respect 
to .’ts role in state -level administration of vocational -technical educa- 
tion. Since administration is thou^t of as a social process, an attempt 
was made to study the SDVE in situation, i, e. , within the setting of its 
interactive process. 

Complex societies designate organizations to perform necessary tasks 
or functions. Public education is a task left, generally, to the schools, 
and within the structure of education are organizations with specialized 
functions or roles. This study focused upon a generalized or institutional 
role, following the notions of Bennis, that "valid knowledge is. . .know- 
ledge of an applied social science. . . that accepts the premise that groups 
and organizations as units are as amenable to empirical and analytical 
treatment as the individual" (3:140) and that "groups and organizations 
are taken as analytical and empirical units; they are not reducible. " 

(3:142) 

The investigation employed a general systems approach to the study of 
the SDVE. This approach was implemented by applying aspects of the 
role concept to the analysis of the operation of the SDVE. The SDVE 
was thought of as a subsystem within a larger system and as performing 
for that larger system a definable and patterned function or role which 
could be explained in terms of expectations held for it. The SDVE, as 
an organizational subsystem of a larger system, engages in 



- 34 - 






activities related to goals which are components of the goals of the 
larger system. In engaging in these activities, die SDVE performs a 
function or role which may be generally described as state-level admin- 
istration of vocational education. In performing this function, the SDVE 
comes into contact with a variety of people, representative of many sub- 
publics in the state. Each of the groups with. the SDVE interacts 
has, or believes it has, a legitimate right to expect certain activities 
and functions from the SDVE. 

The people with whom the SDVE interacts may or may not perceive the 
SDVE in the same or similar ways. In like manner, these people may 
hold differing perceptions of what the SDVE should be or should do. 

Social changes are demanding that the SDVE maintain or develop strong 
dynamic leadership and viable relationships with the local school dis- 
tricts. Sweeping changes in our social and technological foundations 
may cause perceptions of what the SDVE should do to change rapidly. 

The SDVE, to perform its function most effectively, must be aware of 
the way other people view it, of perceptions and ejqpectations held for 
it. 

Research done within the concept of role and role analysis has provided 
growing awareness of the importance of role concept in education. In 
general, role studies have indicated that when the concerned differ in 
their perceptions of what a role is, or should be, conflicts and a de- 
crease in effectiveness and efficiency may result. In a system as com- 
plex and diverse as American education, it is important that the role 
of the administrative or controlling agency be understood. 

The literature on the State Department of Education (SDE) (and indirectly 
the SDVE) supports the notion that state -level educational administration 
is a combination leadership -regulatory function. On the one hand, basic 
social forces, coupled with a rapid expansion of education and education 
needs at all levels of society have created new challenges for education. 
Increased Federalinterest in the problems of education, and new or in- 
creased Federal programs for education are adding to the need for strong 
state educational leadership, and to the need to study and understand 
the respective organization and role of each component in the education- 
al system. On the other hand, the regulatory function still must be 
carried out. Particularly on die state level, there is need for control 
of funds and the improvement of and checking upon programs to meet 
predetermined standards. 

This study viewed the SDVE both in terms of the traditional regulatory 
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function and an emergent leadership -change function. One assumption 
implicit in the study was that changing times are demanding that more 
emphasis be placed upon tlie leadership function and less upon the 
regulatory . One dimension of the leadership function was thou^t to be 
the involvement- -in the planning states and perhaps at the decision- 
making level— of pertinent groups, both of educators and of other 
persons. * 

The role of the SDVE> which in the past may have been primarily com- 
pliance checking-inspection -regulation and secondarily change -leader- 
ship, may now need to emphasize, and be expected to emphasize, the 
chaige -leadership aspect and diminish the supervision -inspection -re- 
gulation aspect. 

Since an analysis of the perceived (actual) and expected (ideal) role of 
the SDVE was one aspect of this study, some reliance was made upon 
research and concepts from role and role analysis. Questions such as 
"What is the role of the SDVE?", or, "What is the role of the Federal 
government in the support of education?", reflect a generalized or insti 
tutional role concept; whereas the role concept is most generally 
thought of as applied to the functioning of an individual acting within the 
framework of an organization. In this study the role concept was 
broadly applied to the functioning of an organizational subsystem with- 
in a larger system. Role has been variously defined. A sample of 
definitions from role literature might help clarify the concept of role. 

... it is the participation of an actor in a patterned inter- 
active relationship which is for many purposes the most 
significant unit of the social system. This participation 
in turn has two principal aspects. . . there is the processual 
aspect, that of what the actor does in his relations with 
others seen in the context of its functional significance for 
the social system. It is this which we shall call role. (26:25) 

Roles are institutionalized when they are fully congruous with 
the prevailing culture patterns and are organized around ex- 
pectations of conformity with morally sanctioned patterns 
of value -orientation shared by the members of the col- 
lectivity in which the role functions. (27:23) 



Appendix I outlines the concept of leadership-change . 
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Roles thus represent ways of carrying out the functions 
for which positions exist****ways which are generally 
agreed upon within whatever group recognizes any 
particular position and role. (23:280)* 

A social role is commonly defined as a set of e:'^;cta* 
tions oriented toward people who occupy a certain 
'position' in a social system or group. (24:283) 

If the goals and purposes of the institution are know, 
the tasks to achieve the goals may be specified, and 
these may be organized into roles. . .Roles represent 
positions, offices, or statuses within the institution. . . 

Roles are institutional givens. . .The behaviors asso- 
ciated with a role may be thought of as lying along a 
continuum from required to prohibited. . . Roles are 
complementary. Roles are interdependent in that 
each role derives its meaning from other related 
roles in the institutior (12:425-427) 

Extension of the basic systems model suggests that an organization can 
be analyzed as a subsystem of a larger system sharing in the larger 
system's value -orientation, and that concepts from role theory can be 
used in developing a framework for this analysis. 

. . . the most essential feature of the value system 
of an organization is the evaluative legitimation of 
its place or "role" in the superordinate system. 

(25:67-68) 

As mentioned previously in such a framework, each social system, at 
whatever level of generalization, is composed of some form of organ- 
ization and role structure. Thus, the general concept of role can be 
applied to the functioning of an organization operating towards the 
attainment of a goal within a structured social system. An organiza- 
tion within a social system must have some function or role defined for 
it, and some general agreement among its members and its client groups 



* Note that "generally agreed upon" does not define an absolute, but 
that it leaves room for degrees, or states of agreement. These 
varying degrees of agreement between and among people can be 
thou^t of as states of consensus. 
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in respect to what the organization is or does, or what it should be or 
should do. Diverse or conflicting perceptions can cause a poorly func- 
tioning organization. 

This investigation was conducted as a field study based upon ex post 
facto research design, with the accompanying strengths and IfimtaHbns 
as enumerated by Kerlinger (16:387, 389-391). For purposes of study, 
the SDVE was conceived of as a combination leadership-regulation 
agency (4, 5, 6, 7, 22, 31, 11). Leadership and regulation were not 
thought to be discrete role categories, but as located along a continuum. 
Involvement was thought to be one dimension of leadership. The study 
design was so developed that an emphasis upon leadership or regulation 
activities could be identified within the general framework. In this in- 
vestigation, some aspects of the role concept were employed in the 
theoretical design. 

Role theory has been used by social scientists for analysis of the func- 
tioning of social systems. In this study, a general systems approach 
implemented by applying aspects of the role concept was utilized. The 
SDVE was thought of as an organization operating as a component of a 
larger educational system. It could then be conceived of as a sub- 
system of a more comprehensive social system and as performing a 
function or role for the larger social system. Since administration is 
a social process and was studied as a situational factor in this investi- 
gation, it was helpful to reply upon a sociological model as a basis for 
this study. The SDVE, an organization established for the purpose of 
state-level administration of vocational education, has certain character- 
istics of an organization: 

1. The SDVE can be located; its position and/or 
function can be defined by reference groups. 

2. The SDVE is purposive. It has been established 
to meet and achieve goals . 

3. The SDVE has been legitimated. 

4. The SDVE is characterized by structural and 
functional hierarchial relationships. 

5. The SDVE is staffed and interactive. It is a 
social system and a part of a larger and more 
complex social system. 



o 
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These ideas may be expressed within the framework of the construct 
presented by Cuba and Getzels. (12:4:26) 



NOMOTHETIC 
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System ^ 
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-> Role 



Role 
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Talcott Parsons has suggested that an organization could be analyzed as 
a subsystem of a larger system.(26:67-68) Parson’s formulations make 
distinctions between institution and collectivir^ (organization) and 
suggest that the role concept can be used to stu^ the institution as well 
as the collectivity. Thus a collectivity is a social system, an institution 
is a social system, and a social system is constituted of interactive 
subsystems of institution and collectivity. In this structure each social 
system, at whatever level of generalization, is composed of some form 
of organization and role structure. (11 :39, 133) 

An extension of the previously mentioii«;d formulation, as reported by 
Getzels and Thelen (13:72), suggestb that a total institution may be 
studied in terms of its generalized role within a r ir. comprehensive 
system. 
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Consensus, i.e. , that members of an organization or social system 
hold the same perceptions of the actual and ideal role for the same po- 
sition, cannot be assumed. Consensus may fall on a continuum from 
complete institutionalization to complete breakdown of order. (11:39) 

The institutionalization of a set of role expectations and of 
the corresponding sanctions is clearly a matter of degree 
. . .The polar antithesis of full institutionalization is, 
however, anomie^ the absence of structured complemen- 
tarity of the interaction process or, ^at is the same thing, 
the complete breakdown of normative order in both senses. 



o 
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Within this framework, the SDVE was seen as performing both a trad- 
itional regulatory function. The traditional regulatory function was 
thou^t to include such activities as (1) setting and maintaining minimum 
standards, (2) keeping records and making reports, (3) checking local 
district compliance with state regulations, (4) developing uniform state- 
wide curricula and (5) inspecting local district facilities and programs. 

The emergent SDVE leadership role was conceptualized as including 
activities related to (1) setting goals, (2) defining problems, (3) resear- 
ching, (4) developing programs, (5) field testing, (6) dissemination, and 
(7) implementation. The involvement in these activities of at least four 
agencies: (1) State Department of Education, (2) local schools, (3) higher 
education, and (4) Fe(teral government was seen as one dimension of the 
leadership-change function. This formulation is detailed in Appendix I. 



C. Report of the Perceptions Study Based Upon 
the Group Interview Guide 



1. The Group Interview Guide 

The procedures for accomplishing this research can be divided into 
three main categories: (1) development of an instrument for data col- 
lection, (2) gathering of data, and (3) processing and analysis of the 
data. 

The basic procedures in tlie development of an instrument for data 
collection are included in the Final Report for Project 5-8466. * The 
instrument resulting from this process consisted of seven sections 
and a personal data resume. 

Drafts of the instrument were field-tested in a variety of situations: 

(1) in a large city, (2) in an educational administration class in a uni- 
versity, (3) in the SDVE of a western state, and (4) in two pilot states, 

(A and B) using the range of respondents seen as pertinent for this study. 



* "Identification and Development of Instruments for a Study of the 
Expectations and Perceptions of the State Vocational -Technical Edu- 
cation Agencies and Their Influence Upon Local Programs. " USOE 
Project No. 5-8466, January, 1967. 



ERIC. 
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Data from statas A and B**“N=45 and N=43 were tabulated and a frequency 
distribution was derived. An item analysis was done, based upon the 
distribution of responses of the three following respondent sub**groups. 

Group I Members of the SDVE (N=27) 

Group II Lxx:al, area, and higher education (N=31) 

Group 111 Other respondents (N=30) 

Steps initiated under project 5-8466 were continued in the present project. 
After data had been collected in nineteen states, some revisions of the 
instrument were undertaken as a result of preliminary analysis and re- 
spondent verbal feedback. Changes and improvements were made on 
the group data instrument such that some of the original items were re- 
moved and new items were added. The wording of a few items was 
changed slightly for clarity . The result was that some items were 
common to both group data instruments, and some items were included 
only on one or the other group data instrument. * 



2. Data Collection 

A purposefully selected sample was used in this stuc^. The sample was 
made up of educators from the various educational institutions and or- 
ganizations within a state, and of persons from other organizations and 
agencies that interact with the SDVE or are related in some way to, or 
have an interest in, vocational education. 

Respondents from thirty -eight states, or approximately seventy-six 
percent of the planned total of fifty states, made up the sample for this 
study. Since a stale was in no way obliged to participate in the project, 
scheduling of data sessions was dependent upon the convenience of the 
states, and arrangements were handled only through the office of the 
project director. Scheduling was further complicated by individual 
commitments of the proposed respondents. 

In two pilot states the project staff at Berkeley attempted to select re- 
spondents by name from state directories. Many "long distance" pro- 
blems arose in (1) arranging a schedule to accommodate the respondents. 



* Data are reported in three ways: (1) items common to both group 
data instruments, (2) items included only on the first group instru- 
ment, and (3) items included only on the second group instrument. 

Separate analyses were done as appropriate. 
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(2) arranging last-minute alternates for those who could not attend, 

(3) finding replacements for those who had left the position for which 
they were listed in the directory, and (4) checking last-minute details. 
It became apparent that respondent selection had to be handled at the 
state level. Categories of proposed respondents had been developed in 
the earlier stages of the project. This list of categories, suggestions 
for selecting the respondents, and the proposed number of respon- 
dents in each category were sent to the state. The state staff was re- 
quested to select the necessary respondents using the respondent cate- 
gories as guidelines. 

By leaving actual respondent selection to each state, except where the 
incumbent of a specific position was requested, there was danger that 
only ’'friends" of vocational education would be selected. There was no 
control of this variable other than a request in the letter of instruction 
that the state try not to "stack the cards". The problems mentioned 
above made other methods of selection impractical. 



3. Processing and Analysis of Group Interview Data 

Preliminary Data Processing Steps* 

Each respondent was identified by a two digit state number and four 
digit number corresponding to the number on the Group Interview Guide 
that he completed. In addition, respondents were classified according 
to a predetermined respondent category list. Three points of reference 
were used for this classification: (1) a respondent's own description of 
his job and employer, (2) the State education Directory, and (3) the 
letter of invitation designating proposed respondent categories. After 
coding, raw data from the group instrument were converted to machine - 
usable form. Data were then checked for conversion accuracy and were 



Much of the data processing work for this project was performed 
through an arrangement with the Survey Research Center (SRC) at 
the University of California, Berkeley. Among SRC services were: 
(1) conversion of data to machine -usable form, (2) establishment 
and maintenance of the data bank, and (3) programming, computer, 
and consultant services as needed. Computer processing, unless 
otherwise noted, was performed on an IBM 1620, Model II. Some 
data processing and analysis made use also of an IBM 7040 loca- 
ted at the Computer Center of the University of California, Berkeley. 



- 42 - 



loaded to magnetic tape for ease of storage, retrieval, and use. 



Groups and Items for Analysis 

There were many possible logical ways to divide the total number of 
respondents into subgroups for data analysis. A major limitation on 
the number of subgroup cUvisions was the number of respondents in 
each subgroup. At the outset of this study, a respondent category list 
was developed. The sample requested in each state was based upon 
this list. I^ally, there would have been enough respondent cases in 
each category to allow comparisons to be made with each group. Prac- 
tically, it was noted that some combining of categories would probably 
be necessary. Some combined groups were used as crossbreaks for 
data analysis purposes. These groups made up from the combined re- 
spondent categories were then used as corssbreaks for data analysis. 
These groups easily produced many more possible combinations of 
data analysis crossbreaks than were used. Since the focus of this 
study was the SDVE, the SDVE group was used as one crossbreak var- 
iable in most of the analyses. Besides comparisons based upon respon- 
dent category as related to the sample, there were other kinds of com- 
parisons which were hypothesized to be important, but which, for one 
reason or another, were not made. Some of these crossbreaks could 
be determined from the respondent information available from the per- 
sonal data summary, others from geographic, demographic, or state 
organization characteristics. 

Not all items from die instrument were individually used in the analysis 
reported here, although response frequencies for all items are reported 
to the appendix. Some items were used only as they contributed to the 
composition of a cluster. 



Item Cluster Development 

A priori item clusters which could be scored and treated as units were 
designated and tested. Items were first classified into three broad 
categories: (1) leadership-change, (2) inspection-reguktion, and (3) 
involvement. From the broad categories, seven item clusters confor- 
ming to major areas of concern in this study were designated a priori. 

1. Present degree of SDVE leadership function. 

2. Ideal degree of SDVE leadership function. 

3. Present degree of SDVE regulation function. 



- 43 - 



4. Ideal degree of SDVE regulation function. 

5. Attitude toward vocational*«technical education. 

6. Present degree of SDVE involvement function. 

7. Ideal degree of SDVE involvement function. 

Using data from five states for pilot work (N=226), a trial scoring key 
for each cluster was designated and a total score for each respondent 
on each cluster was found. A frequency distribution of scores in each 
cluster was generated. The median interval was determined and the 
cluster was dichotomized. Chi-square contingency tables were gener- 
ated for each item as shown in Table 1 on the following page. * Analysis 
on the trail scoring key, cluster index and contingency tables for cluster 
6 indicated many (up to 40% on some items) "don't know" responses. 

The index for this cluster was rebuilt omitting "don't know" responses. 
Items were dichotomized on the basis of the new index.+ 

Since items were assigned a priori, each item was tested not only with 
its a priori cluster score, but also against other cluster scores to 
detect statistical indications that (1) the number of clusters could be 
reduced, and (2) an item difficulty index and a discrimination index in 
the form of a chi-square with three or four degrees of freedom, de- 
pending upon the item. 

On the basis of pilot analyses, item clusters were revised and the item 
scoring key was corrected for dichotomous scoring. 

Some revision in the Group Interview Guide made a reformulation of 
clusters and a corresponding recomputation of reliability coefficients 
and correlations necessary. In each case, the dual computations are 
indicated by the numter of respondents (N=905, N=878) for each group 
of data. 

A procedure slightly different from the original was used to develop the 
item clusters for the second batch of data. Since most of the items for 



Response category "uncertain" was treated as no response. The 
clusters were derived using percentages based upon ^e number 
of respondents minus the number of respondents marking "un- 
certain" and not responding. 

^ This index was also used in developing a "does" score and a 
"should" score for each respondent on section IV of the data in- 
strument. . 
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the original clusters were a^so present for the revised clusters, the 
trial scoring key was developed from the items which had already been 
selected for the original clusters and which were retained on the new in- 
strument. Responses to these items were dichotomized, and responses 
to new items were tested in relation to the new indices with a chi-square 
test. From the comparison of the chi-square results and the a priori 
assumptions for each item, the new items were dichotomously scored 
and assigned to the appropriate clusters. The new clusters were then 
used in analysis of responses of the second group of respondents. (N=878) 



Missing Data in Item Cluster Scores 

The possibility of missing data was inherent in tlie data collection in- 
strument (e. g. r< pondents could elect not to respond to any item; in 
section I they could choose "uncertain" and in sections V, \h, and VII, 
they could choose "don't know"). Such responses were treated as 
missing data in an item cluster, but were retained in single item anal- 
ysis. To accommodate these contingencies in dichotomous scoring, 
each respondent's cluster score was derived as a proportion of his 
responses by omitting any response classified as missing data. * This 
procedure, while not entirely satisfactory, was preferred to treating 
"no response", or "uncertain" and "don't know" choices as either 1 or 
0 in dichotomous scoring. 



Cluster Difference Scores"*" 

Cluster difference scores between similar clusters were obtained by 



* i.e., i 1 

Items in the basic clusters were individually dichotomized and 
scored so as to maximize item discrimination and cluster relia- 
bility. For the cluster difference scores, the same item had 
to be similarly dichotonized for both the "does" and "should" di- 
mensions. This necessitated a rescoring of each item and some 
compromise with maximum dichotomization. Mean standard 
deviations and reliability coefficients for the common item clus- 
ters are presented in Appendix IV, H and I. Common item cluster 
means and standard deviations were used in obtaining the relia- 
bility coefficients of the cluster difference scores. 
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subtracting (for item stems common to each cluster, but different in 
terms of the "does ’should" dimensions) the respondent's "does" score 
from his "should" score on each item. These ifferences were totaled. 
A constant, 1, was added to each total to circumvent negative numbers. 



Group Interview Guide Section IV Scores 

Both a "does" and "should" score on section IV of the group instrument, 
as well as a "does -should" difference score for s ction IV was gener- 
ated for each respondent. These scores were treated in the same manner 
as other cluster scores. 



Cluster Reliability 

The reliability of each basic cluster and the section IV scores (clusters) 
was estimated by the Kudei -Richardson Formula 20. * 



Corrections for missing data in the dichotomous scoring were made in 
the following manner. The mean and standard deviation of each cluster 
were multiplied by the number of items in that cluster, since the mean 
for each cluster was a proportion: y r O The 

—TT+Tn ~ 






N 



reliability coefficients are presented in Table 2. 4= 



* This formula is: r,.,. = k 1 " pg . 

“in- -3- 

Multiplication of the mean and standard deviation by a constant 
does not influence their relative values. 

4= Reliability (r) or difference scores (i.e., clusters 10c, 11c, 12, 
and 13c was computed by the formula: 
ni + ^22 - ri2 
Rdlff = 2 

1-^12 

Robert L. Thorndike and Elizabeth Hagen, Measurement and Eval - 
uation, (second edition; New York; John Wiley & Sons, Inc., W62), 
p. 19i. 
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TABLE 2 



RELIABILITY COEFFICIENTS FOR CLUSTER SCORES 
SECTION IV SCORES AND CLUSTER DIFFERENCE SCORES 



Cluster 


Designation 


Reliability 
(N=905) (N=878) 


1 


Actual Leadership 


.93 


.87 


2 


Ideal Leadership 


.90 


.87 


3 


Actual Regulation 


.86 


.86 


4 


Ideal Regulation 


.75 


.69 


5 


Attitude towards Vocational- 








Technical Education 


.57 


.59 


6 


Actual Involvement 


.94 


.95 


7 


Ideal Involvement 


.89 


.87 


8 


Section IV, Should 


.91 


.90 


9 


Section IV, Does 


.94 


.95 


IOC 


Leadership Difference: Common 








Items (clusters 2 - 1 ) 


.86 


.85 


lie 


Regulation Difference: Common 








Items (clusters 4 - 3 ) 


.66 


.69 


12C 


Involvement Difference: Common 








Items (clusters 7 - 6 ) 


.84 


.80 


13C 


Section IV Difference: Common 








Items (clusters 8 - 9 ) 


.81 


.84 



Both item cluster scores and individual items were used in the data 
analysis. Chi-square tests were used for single items; analysis of var- 
iance techniques were used when data were scored. Correlations between 
and among the clusters were developed from responses to items in the 
clusters. Some simple arithmetic computations were made, such as 
totalling responses or obtaining averages, and data were ranked or 
grouped to facilitate analysis. 



Chi-Square Tests 

The non-parametxic chi-square test for independent samples was used 
to test for significance of differences in respondent group response fre- 
quencies on single items. The chi-square test was also used to test for 
significance of differences in a single group's responses to the "does" 
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and the "should" dimension of the same item stem. 



Analyses of Variance 

Analyses of variance were used to test for significance of differences 
among respondent groups in their responses to the item clusters. 
Analysis of variance techniques were also used to substantiate the 
a priori grouping of three respondent subgroups into one larger respon- 
dent group. 



Correlational Techniques 

Thirteen -by -thirteen Pearson product-moment correlation matilces 
were developed for the respondent scores obtained from the clusters. 

A separate matrix was generated for each one of these groups of respon- 
dents (N=905 and N=878). 



Ranking and Grouping 



Respondent means and standard deviations, as well as consensus on 
single items, were grouped and ranked to aid in interpretation of re- 
sults and discussion of die relationships between and among respondent 
groups, item, and item clusters. Consensus was taken to be that sum 
of percent of responses in two contiguous categories (excluding "un- 
certain", "don't know", or no response) which produced the highest 
total percent. For classification purposes, the following categories of 
consensus were defined: 



100-90% 

89-80% 
79-70% 
69-60% 
Less than 



High Consensus 
High-Medium Consensus 
Medium Consensus 
Low Consensus 
Lack of Consensus 



4. Results of Investigation 



Extremely long or detailed results are contained in the appropriate 
appendix and summary tables are shown here. Occasionally, for par- 
simony in reporting, two results are contained on one table . Whenever 
this occurs, a discussion of both results will be contained in the dis- 
cussion section and the title of the table will make reference to both 
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kinds of results. 



Results are presented in this section in the following sequence: 

a. Results of chi-square tests for differences in group 
response frequencies for items from the Group Inter- 
view Guide. This table also indicates which items 
were chosen for each item cluster. 

b. Means and standard deviations of respondent groups 
for cluster scores. 

c. Summary of analyses of variance tests on cluster 
scores, including groups used for analysis and signifi- 
cance of results. 

d. Correlation matrix for item cluster scores, Section IV 
scores and common item cluster difference scores. 

e. Results of chi-square tests for differences in Group 
"does" and "should" response frequencies for the 
same item for Section II and VII of the Group Interview 
Guide. 

f. Mean cluster scores of selected respondent groups 
(plotted as bar graphs). 

g. Relationship of actual and ideal involvement of 
selected respondent groups in SDVE activities 
(plotted as bar graphs). Actual percents appear 
as Appendix II, E. 

h. Relationships of selected respondent group mean scores 
on two item clusters (represented as scatter plots). 

i. Results pertaining to identification and analysis of 
bridges and obstacles . 
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DESCRIPTORS- ^VOCATIONAL EDUCATIONt ^NATIONAL SURVEYSt 4STATE 
DEPARTMENTS OF EDUCATIONt STATE FEDERAL SUPPORT t STAFF ROLEt 
ROLE PERCEPTION, SELF EVALUATION, MEASUREMENT INSTRUMENTS, 
EXPENDITURES, ^EDUCATIONAL ADMINISTRATION, «PROGRAM 
EVALUATION, TECHNICAL EDUCATION, VOCATIONAL EDUCATION 
TEACHERS, PROFESSIONAL PERSONNEL, ORGANIZATION, STUDENT 
ENROLLMENT, EDUCATIONAL PROGRAMS, LEADERSHIP RESPONSIBILITY, 

THE OBJECTIVES OF FIVE RELATIVELY INDEPENDENT STUDIES 
WERE TO DESCRIBE AND INDICATE DIFFERENCES OF ORGANIZATION, 
PERSONNEL, AND SERVICE IN THE STATES, IDENTIFY AND ANALYZE 
PERCEPTIONS OF STATE AGENCY ROLES AND FUNCTIONS, ANALYZE 
ACTIVITIES OF. SELECTED PROFESSIONAL STAFF POSITIONS, DESIGN 
AND FIELD TEST AN INSTRUMENT FOR SELF ANALYSIS OF STATE 
AGENCIES, AND ANALYZE STATE AND FEDERAL EXPENDITURES FOR 
VOCATIONAL PROGRAMS. DATA WERE OBTAINED IN VISITS TO THE 
STATES AND PUERTO RICO THROUGH GROUP AND INDIVIDUAL 
INTERVIEWS AND RECORDS, AND OTHER DOCUMENTS. CONCLUSIONS 
INCLUDED-- (1) THERE WAS GREAT VARIATION AMONG THE 50 STATES 
IN THE RATIO OF PROFESSIONAL STAFF MEMBERS IN THE STATE 
AGENCY TO VOCATIONAL TEACHERS, (2) THE STATE DEPARTMENT OF 
VOCATIONAL EDUCATION WAS LESS CONFIDENT ABOUT THE JOB IT WAS 
DOING THAN WAS THE GROUP TO WHICH IT WAS IMMEDIATELY 
RESPONSIBLE, (3) ALL GROUPS INDICATED THE MAJOR PORTION OF 
THEIR TIME WAS SPENT PLANNING, CONSULTING, COMMUNICATING, AND 
TRAVELING, WITH THE MAJOR FOCI PROBLEM IDENTIFICATION AND 
DEFINITION, AND PROGRAM DESIGN AND DEVELOPMENT, AND (4) THE 
TOTAL EXPENDITURES MORE THAN DOUBLED BETWEEN 1962-63 AND 
1965-66. A "FORMAT AND CRITERIA FOR SELF-ANALYSIS BY STATE 
AGENCIES FOR VOCATIONAL-TECHNICAL EDUCATION” WAS DESIGNED, 
DEVELOPED, PARTIALLY REFINED AND INITIALLY FIELD TESTED. 
VOLUME II CVT 004 416) CONTAINS THE APPENDIX TO THESE 
STUDIES. (EM) 







